Internet Archive's in-browser bookreader "theater" requires JavaScript to be enabled. It appears your browser does not have it turned on. Please see your browser settings for this feature.

Reducing Manual Supervision Required for Biodiversity Monitoring with Self-Supervised Learning

by: Pantazis, Omiros; Brostow, Gabriel; Jones, Kate; Mac Aodha, Oisin

Publication date: 2021-9-7
Usage: Attribution 4.0 International
Topics: computer vision, deep learning, camera traps
Publisher: Pensoft Publishers
Collection: biodiversity
Contributor: Pensoft Publishers
Language: English
Rights: https://biodiversitylibrary.org/permissions
Rights-holder: Copyright held by individual article author(s).
Volume: 5
Item Size: 2.8M

Abstract: Recent years have ushered in a vast array of different types of low cost and reliable sensors that are capable of capturing large quantities of audio and visual information from the natural world. In the case of biodiversity monitoring, camera traps (i.e. remote cameras that take images when movement is detected (Kays et al. 2009) have shown themselves to be particularly effective tools for the automated monitoring of the presence and activity of different animal species. However, this ease of deployment comes at a cost, as even a small scale camera trapping project can result in hundreds of thousands of images that need to be reviewed.
Until recently, this review process was an extremely time consuming endeavor. It required domain experts to manually inspect each image to:

determine if it contained a species of interest and

identify, where possible, which species was present. Fortunately, in the last five years, advances in machine learning have resulted in a new suite of algorithms that are capable of automatically performing image classification tasks like species classification.

determine if it contained a species of interest and
identify, where possible, which species was present. Fortunately, in the last five years, advances in machine learning have resulted in a new suite of algorithms that are capable of automatically performing image classification tasks like species classification.
The effectiveness of deep neural networks (Norouzzadeh et al. 2018), coupled with transfer learning (tuning a model that is pretrained on a larger dataset (Willi et al. 2018), have resulted in high levels of accuracy on camera trap images.
However, camera trap images exhibit unique challenges that are typically not present in standard benchmark datasets used in computer vision. For example, objects of interest are often heavily occluded, the appearance of a scene can change dramatically over time due to changes in weather and lighting, and while the overall number of images can be large, the variation in locations is often limited (Schneider et al. 2020). These challenges combined mean that in order to reach high performance on species classification it is necessary to collect a large amount of annotated data to train the deep models. This again takes a significant amount of time for each project, and this time could be better spent addressing the ecological or conservation questions of interest.
Self-supervised learning is a paradigm in machine learning that attempts to forgo the need for manual supervision by instead learning informative representations from images directly, e.g. transforming an image in two different ways without impacting the semantics of the included object, and learn by imposing similarity between the two tranformations. This is a tantalizing proposition for camera trap data, as it has the potential to drastically reduce the amount of time required to annotate data. The current performance of these methods on standard computer vision benchmarks is encouraging, as it suggests that self-supervised models have begun to reach the accuracy of their fully supervised counterparts for tasks like classifying everyday objects in images (Chen et al. 2020). However, existing self-supervised methods can struggle when applied to tasks that contain highly similar, i.e. fine-grained, object categories such as different species of plants and animals (Van Horn et al. 2021).
To this end, we explore the effectiveness of self-supervised learning when applied to camera trap imagery. We show that these methods can be used to train image classifiers with a significant reduction in manual supervision. Furthermore, we extend this analysis by showing, with some careful design considerations, that off-the-shelf self-supervised methods can be made to learn even more effective image representations for automated species classification. We show that by exploiting cues at training time related to where and when a given image was captured can result in further improvements in classification performance. We demonstrate, across several different camera trapping datasets, that it is possible to achieve similar, and sometimes even superior, accuracy to fully supervised transfer learning-based methods using a factor of ten times less manual supervision. Finally, we discuss some of the limitations of the outlined approaches and their implications on automated species classification from images.
Addeddate: 2025-06-09 20:03:10
Bhl_virtual_titleid: 210882
Bhl_virtual_volume: v.5 (2021)
Call number: 10_3897_biss_5_74047
Call-number: 10_3897_biss_5_74047
Foldoutcount: 0
Genre: article
Identifier: reducingmanuals5pant
Identifier-ark: ark:/13960/s2bxh49t0d3
Identifier-bib: 10_3897_biss_5_74047
Identifier-doi: 10.3897/biss.5.74047
Ocr: tesseract 5.3.0-6-g76ae
Ocr_detected_lang: en
Ocr_detected_lang_conf: 1.0000
Ocr_detected_script: Latin
Ocr_detected_script_conf: 1.0000
Ocr_module_version: 0.0.21
Ocr_parameters: -l eng
Page_number_confidence: 64
Page_number_module_version: 1.0.5
Page_range: 1-3
Pages: 3
Pdf_degraded: invalid-jp2-headers
Pdf_module_version: 0.0.25
Possible copyright status: In copyright. Digitized with the permission of the rights holder.
Ppi: 300
Source: Biodiversity Information Science and Standards 5
Year: 2021